npj Imaging

The lifetime of fluorescent molecules provides an orthogonal readout to fluorescence intensity, opening experimental possibilities of measuring changes in local molecular environments, mechanical tension, and metabolism, among other factors. These changes are best studied live and in vivo; however, limitations of slow imaging speeds, high phototoxicity, and increased data size and complexity have significantly impeded progress on this front. Here, we present a complete and transferable pipeline consisting of a light sheet FLIM microscope and an accompanying machine learning model for data processing that renders long-term and/or high-speed volumetric FLIM (vFLIM) tractable in living systems. We benchmark this pipeline across several biological use cases, model systems, lifetime ranges, and spatiotemporal scales, showcasing a suite of possibilities that our workflow enables. This comprehensive pipeline from imaging to analysis is a crucial step forward towards disseminating the power of live vFLIM to the broader bioimaging community.

Virtual staining provides a non-invasive alternative to fluorescence microscopy, yet existing deep learning approaches fundamentally rely on pixel-aligned, multiplexed fluorescence targets for supervision. This dependence on rigidly paired data limits scalability, constrains flexibility in generating diverse subcellular structures, and becomes impractical in data-scarce biological settings. In this work, we introduce a semantic supervision paradigm for virtual staining, demonstrating that domain-knowledge prompts can effectively replace conventional pixel-level supervision. Unlike existing methods constrained by rigidly paired multiplex targets, our framework leverages biological prompts to decouple structural guidance from image translation. This decoupling enables high-fidelity, independent synthesis of multiple subcellular structures using only single-channel data. To ensure high-fidelity generation under weak supervision, we integrate self-supervised representation learning to mitigate data scarcity and incorporate direct preference optimization to suppress structural artifacts. Evaluations on the JUMP benchmark demonstrate that our approach effectively balances flexibility and fidelity, outperforming supervised baselines with a 43.3 % reduction in Average FID and an Average PCC of 0.912, while exhibiting high robustness in channel-deficient scenarios. Furthermore, the model generalizes across four in-house datasets to successfully multiplex six subcellular structures, overcoming the physical constraints of conventional fluorescent staining.

Fluorescence lifetime imaging microscopy (FLIM) provides molecular contrast that is largely independent of fluorophore concentration, yet it remains constrained by a persistent trade-off among acquisition speed, photon dose, and detector complexity. To address this challenge, we developed image-projection fluorescence lifetime imaging microscopy (IP-FLIM), an integrated optical and computational platform that enables high-resolution, component-resolved lifetime imaging using only a linear single-photon avalanche diode array. We validate IP-FLIM using fluorescent microbeads and bovine pulmonary artery endothelial cells, demonstrating up to 22.3x improvement in contrast-to-noise ratio and 72.3% reduction in background noise over conventional filtered back-projection reconstruction. By combining wide-field projection acquisition with computational k-space reconstruction, IP-FLIM provides a scalable route to fast, high-resolution multiplex lifetime imaging.

Cell morphology reflects cell health and can distinguish cell-cycle stage, growth arrest, and distinct pathways of cell death. Live, label-free quantitative phase imaging (QPI) captures these features non-invasively and with high temporal resolution, yet many image-based classifiers rely on single frames and cannot separate states whose differences emerge only over time. How much temporal information is needed, and which architecture best exploits it, remain open questions. We assembled 1,874 QPI timelapse sequences spanning six cell states (interphase, mitosis, cell cycle arrest, apoptosis, ferroptosis, and necroptosis) and compared two-dimensional convolutional neural networks (CNNs) with a three-dimensional (3D) spatiotemporal CNN across increasing frame counts. Accuracy improved as frames were added, with the largest gain between one and three frames. The 2D models saturated beyond three frames, whereas the 3D architecture kept improving, reaching 96.5% accuracy and a 3.5% error rate at eleven frames. The temporal information needed tracked the timescale of each process: mitosis was resolved from a single frame, while ferroptosis benefited most from extended sequences. Overall, these results show that dynamic information, rather than static morphology alone, drives accurate cell-state classification, and that 3D architectures are needed to fully exploit it for label-free dynamic phenotyping.

Light-sheet fluorescence microscopy (LSFM) has revolutionized biological imaging by enabling high spatial and temporal resolution with minimal photodamage. However, conventional LSFM techniques often suffer from striping artifacts in the resulting images due to light scattering and absorption within samples, leading to uneven illumination that negatively impacts the accuracy of subsequent image analyses. To address this limitation, we introduce dodecagon light-sheet fluorescence microscopy (dodecaLSFM), a novel approach that maximizes angular diversity to achieve homogeneous illumination and suppress striping artifacts. dodecaLSFM employs diffraction optics and cylindrical lenses to generate twelve light sheets, providing 360 degree omnidirectional illumination that significantly enhances illumination uniformity compared to traditional mSPIM, mDSLM, and ultramicroscopy systems, which use only one or two illumination planes. We demonstrate the effectiveness of dodecaLSFM by achieving high-resolution imaging of whole mouse brain vasculature following tissue clearing, allowing precise morphometric analysis of vascular networks without striping artifacts. Furthermore, we show that combining dodecaLSFM with expansion microscopy (ExM) enables whole-organ 3D imaging at cellular resolution. This novel approach provides an advanced, scalable solution for large-volume imaging, facilitating detailed structural and functional studies across diverse biological applications.

Cryo-volume electron microscopy (cryo-vEM) enables near-native visualization of cellular ultrastructure, but its broad use is limited by low image contrast and the high cost of dense voxel-level annotation. Existing automated segmentation methods often generalize poorly across cell types, organelles, and imaging conditions. Here, we introduce SparseSeg, a target-conditioned, sparsity-driven segmentation framework that treats organelle segmentation as a discovery process rather than a closed-set classification task. SparseSeg uses a small number of context-specific exemplars to iteratively propagate reliable supervision through the volume. It combines sparse patch-based sampling, a multi-kernel U-Net, and geometry-consistent refinement to expand accurate segmentation while suppressing context-dependent false positives. Across serial cryo-FIB-SEM and conventional vEM datasets, SparseSeg achieves robust segmentation under extreme sparse annotation, including settings with less than 1% labeled slices. This framework reduces annotation burden while preserving morphological fidelity for quantitative cryo-vEM analysis.

High-speed three-dimensional imaging in scattering tissues remains challenging because volumetric microscopy generally requires scanning, whereas snapshot light-field approaches divide limited detector pixels among multiple views. This constraint is particularly severe in the second near-infrared window (NIR-II), where commonly used InGaAs cameras typically have relatively small sensor formats and high detector noise. Here we introduce NIR-II squeezed light-field microscopy (NIR-II SLIM), which optically rotates and compresses multiple perspective views before detection, allowing efficient use of camera pixels while retaining complementary spatial information for three-dimensional reconstruction. NIR-II SLIM acquires volumes at up to 600 volumes s-1 with a reconstructed lateral sampling grid of 512 x 512 pixels. We use the method for label-free four-dimensional imaging of cardiac dynamics in pigmented late-larval zebrafish, resolving chamber deformation and millisecond-scale atrioventricular-valve motion, and for NIR-II fluorescence imaging of vascular and lymphatic transport in mice. NIR-II SLIM provides a detector-efficient approach for high-speed volumetric imaging of rapid biological dynamics in scattering tissues.

While light-sheet microscopy is emerging as a robust method for volumetric imaging with improved axial resolution, its capability regarding two-dimensional, surface-level mapping is often hindered by limitations in data redundancy and reconstruction efficiency stemming from volumetric registration methods. We demonstrate that a multiview imaging approach in an axially-swept, dithered light-sheet microscope paired with computational image reconstruction of view projections is able to address these trade-offs to enable large-scale mapping of surface structural features, leveraging the advantages of multiview light-sheet in scalable field of view, working distance, and near isotropic resolution across the entire imaging depth. To aid in the acquisition and analysis of two-dimensional surface structures, we present a tailored surface mapping workflow and a Fiji plugin for computational reconstruction, promoting robust and comprehensive visualization of surface features of uncleared volumetric samples. Our strategy, termed projection reconstruction for imaging surface morphology (PRISM), integrates axially swept dithered light-sheet microscopy and post-processing software for multiview imaging. The imaging hardware enables near-isotropic resolution across its entire field of view, while the software implementation leverages rigid and affine transformations to align two-dimensional projections of multiview samples. It is designed to work with the BigStitcher pipeline, leveraging its robust algorithm to provide support for two-dimensional image alignment and stitching. We demonstrate the capability of PRISM in studies of lymphatic network mapping in the epicardial layer of intact mouse hearts, as well as surface profiles of FaDu spheroids labeled with antibody-nanodiamond conjugates. This method allows us to quantify cardiac lymphatic branch numbers, diameters, and lengths of a Prox1-tdTomato mouse cardiac model, as well as cluster number and diameters of epidermal growth factor receptor within a FaDu spheroid labeled with a nanodiamond-antibody conjugate, with a significant reduction of post-processing data size. PRISM leverages multiview image projections to promote studies of cardiac lymphatics in mouse models and surface receptor distributions within spheroid models, enabling efficient surface mapping of large, intact, and uncleared biological samples across a variety of scales.

In materials science, the integrity of scanning electron microscopy (SEM) images is paramount for quality control and validation of research outcomes. However, the introduction of sophisticated generative artificial intelligence, particularly Generative Adversarial Networks (GANs), has introduced a novel vulnerability: the potential for highly realistic, artificially synthesized SEM images to be used fraudulently in scientific literature. To address this challenge, we present a deep learning-based framework capable of distinguishing between authentic SEM images and those synthesized by Generative Adversarial Networks (GANs). Using FastGAN and StyleGAN2-ADA, two state-of-the-art GAN models, we generated synthetic SEM datasets to complement real imaging data. We fine-tuned a pre-trained Contrastive Language-Image Pre-training (CLIP) Vision Transformer (ViT-L-14) for binary classification. By unfreezing the final transformer blocks and appending a custom classification head, the model effectively captures the subtle, high-level artifacts inherent in GAN-generated upsampling. This work highlights the potential of deep learning to safeguard scientific imaging workflows and provides an important step toward detecting and mitigating image forgeries in materials science publications.

Understanding distributed biological systems, particularly neural circuits, requires simultaneous cellular-resolution imaging across millimeter-scale fields of view (FOV). Existing miniature microscopes remain fundamentally constrained by trade-offs among FOV, spatial resolution, and optical complexity, limiting their ability to bridge cellular microscopy with cortex-scale imaging. Here we introduce distributed computational optics, a framework that distributes image formation across coordinated optical modules and computationally integrates their measurements into a unified image. We realize this framework in Bio-CM2, a computational miniature mesoscope that partitions the imaging field across four optical modules while converging their measurements onto a common image sensor. This architecture overcomes the aberration-scaling limitations of conventional miniature optics while avoiding the hardware complexity of multi-camera systems and the contrast degradation associated with optical multiplexing. Bio-CM2 achieves a 7.5 x 10 mm2 FOV while enabling cellular-resolution in vivo imaging at video rates. We demonstrate its utility through two complementary imaging modalities in head-fixed mice: cortex-wide functional vascular imaging, enabling simultaneous quantification of pial arteriole vasomotion and mesoscale hemodynamic functional connectivity, and cellular-resolution calcium imaging, resolving the activity of over 3,000 neurons together with mesoscale neuronal functional connectivity. We further demonstrate the versatility of the platform through cellular-resolution imaging of entire coronal mouse brain sections, population-scale imaging of freely behaving Caenorhabditis elegans, and odor-evoked calcium imaging of the main olfactory bulb in head-fixed mice, highlighting its broad applicability across diverse biological systems and imaging modalities. By overcoming the conventional trade-off between FOV and spatial resolution in a compact miniature platform, Bio-CM2 establishes distributed computational optics as a scalable framework for multiscale biological imaging.

Soft X-ray tomography (SXT) is an emerging modality for whole-cell 3D imaging in near-native states. However, the effective spatial resolution is limited by optical artifacts characterized by the point spread function (PSF). To achieve optimal resolution via PSF inversion, we propose a measurement-supervised deep learning framework. Bypassing purely data-driven neural networks that are prone to hallucinations, we employ a measurement-supervised, instance-specific optimization strategy strictly constrained by a differentiable SXT formation forward model. The structural fidelity was validated using split-tilt Fourier ring correlation (FRC), ensuring the recovered high-frequency features reflect genuine specimen features rather than random artifacts. Our results demonstrate that this optimization consistently increases FRC resolution and enhances visual ultrastructural details across diverse biological structures. Furthermore, by recovering high-frequency features from sparse-angular projections, we show that spatial resolution can be maintained using only half the radiation exposure. This approach effectively compensates for the degradations caused by angular sparsity, providing a hardware-free computational solution to minimize radiation damage, maximize imaging speed, and overcome the optical and dosimetric limits of SXT.

Quantifying cells within intact three-dimensional biological specimens remains a major challenge, as standard optical and histological techniques are inherently two-dimensional, destructive, or constrained by light scattering. Optical clearing can extend imaging depth but is time-consuming, disruptive to tissue integrity, and often incompatible with downstream analyses, limiting its practical use for routine three-dimensional quantification. X-ray computed tomography can overcome these limitations, yet conventional micro-CT lacks the soft-tissue contrast required for cellular-scale analysis. Here, we introduce an integrated imaging framework in which propagation-based phase-contrast X-ray CT is combined with volumetric nuclear segmentation to enable three-dimensional cell quantification in unstained volumetric tissue. We imaged ex vivo human liver tissue and segmented nuclei throughout the reconstructed volume, extracting quantitative nuclear metrics and spatial organisation metrics, including equivalent diameter, minor-to-major axis ratio and nearest-neighbour distance. We assessed measurement consistency across two non-overlapping volumes of interest and benchmark slice-resolved nuclear metrics against haematoxylin and eosin histology. The resulting high-contrast volumetric datasets preserve tissue context, allowing quantitative measurements to be interpreted alongside surrounding architecture and microstructure. Together, these results show that laboratory phase-contrast X-ray CT supports nucleibased volumetric cell quantification in intact unstained tissue and provides a framework for context-preserving quantitative analysis in three dimensions.

Current segmentation models are capable of routine identification of biological features in noisy cryogenic electron microscopy (cryoEM) images. However, there are still challenges with complete segmentation of high boundary, thin objects such as bacterial cell envelopes and flagella. Moreover, ultralow-dose cryoEM images pose as an additional challenge to boundary distinctions between the object and background. Here, we present TileBac, a benchmark dataset of ultralow-dose montage tiles of Pantoea sp. YR343 to segment bacterial inner and outer membranes for evaluation of model effectiveness. We show that foundation models outperform convolutional neural networks at continuous bacterial cell envelope segmentation despite having lower performance metrics. We release the TileBac benchmark dataset on Hugging Face for further insights into model architecture development.

Clinical treatment planning of near-infrared (NIR) brain stimulation requires patient-specific light dosimetry to optimize fluence delivery to cortical targets. The gold-standard Monte Carlo (MC) photon transport forward solver is accurate but computationally expensive and non-differentiable for personalized inverse design across subjects. Here, we present a foundation-model (FM)-encoded, differentiable implicit-neural surrogate for the MC solver. A pretrained 3D MRI/CT foundation model, VISTA3D, is domain-adapted to head phantoms with known optical properties to encode the subject anatomy. Next, an implicit neural representation is used to predict light fluence at arbitrary continuous coordinates. This formulation enables off-grid queries and gradients with respect to illumination parameters. Trained with a physics-informed, decade-stratified loss, the surrogate attains R2 {approx} 0.90 on held-out subjects. Ablation results show that the FM benefit is contingent on domain adaptation. Benchmarked against standard learned surrogates, our model is the most accurate in the high-dose region and best on dose-fidelity metrics ({gamma}-index, treated-volume DICE). Finally, gradient-based optimization through the surrogate recovers MC-consistent illumination configurations 50-240 x faster.

Targeted radiopharmaceutical development for ovarian cancer (OC) has been limited by the lack of molecular targets that combine broad tumor expression with minimal normal-tissue distribution. TRA-1-60 (TRA) is a cancer-associated glycoepitope carried by podocalyxin. Here, we evaluated TRA as a target for OC and developed a TRA-directed immunoPET imaging platform. Immunohistochemical analysis demonstrated significantly higher TRA expression in ovarian tumors than in normal adjacent ovarian tissue, with expression maintained across epithelial OC histotypes and disease stages. An engineered anti-TRA single-chain variable fragment-Fc (scFv-Fc) demonstrated robust penetration of three-dimensional tumor spheroids and selective accumulation in intraperitoneal tumors in an immunocompetent syngeneic OC model. Radiolabeling with zirconium-89 generated [Zr]Zr-DFO-anti-TRA scFv-Fc with >98% radiochemical yield. Serial PET/CT imaging demonstrated progressive and sustained radiotracer accumulation at tumor sites through 96 hours, accompanied by declining liver-associated activity and low uptake in most normal tissues. Together, these findings identify TRA as a broadly expressed and accessible tumor-associated glycoepitope and establish TRA-targeted immunoPET as a promising strategy for noninvasive detection of OC. The selective and sustained tumor localization of this platform further provides a foundation for development of TRA-directed radiopharmaceutical therapy, supporting a potential theranostic approach for OC.

Label-free scattering imaging is widely used in pathology because it enables sensitive tissue assessment without exogenous contrast agents. Yet its limited optical penetration has prevented scattering-based methods from being applied to whole-organ pathology mapping. Here we present clearing-assisted scattering tomography (CAST), a high-throughput, label-free whole-brain mesoscope enabled by selective lipid clearance for scattering enhancement (SELiC). SELiC modulates endogenous refractive-index heterogeneity in cleared tissue, providing whole-brain optical penetration while retaining strong scattering contrast from amyloid plaques and white-matter fibre bundles. CAST enables volumetric imaging of intact mouse brains and brain-wide mapping of amyloid plaque pathology across anatomical regions. This platform establishes a scalable route for label-free, system-level analysis of amyloid pathology and tissue architecture in Alzheimers disease (AD) models.

Point-spread-function engineering by depth-encoding phase masks enables volumetric super-resolution imaging by 3D single-molecule localization microscopy (SMLM) but usually requires cumbersome relay optics. We demonstrate simple 3D SMLM implementation by phase mask insertion directly into the infinity space of a commercial microscope, along with appropriate computational compensation for field-dependence. The entire inserted component, including the phase mask, is 3D printing-based.

Formalin-fixed prostate tissue samples were imaged by propagation-based synchrotron phase contrast micro computed tomography ({micro}CT) with a 3D spatial resolution of ca. 3 {micro}m. Post-{micro}CT, samples were prepared for histology with sections close to coplanar with the transverse {micro}CT image planes. Haematoxylin and eosin stained sections were examined by an expert prostate histopathologist and compared qualitatively with corresponding {micro}CT-visible microstructure features. There is potential for {micro}CT to provide complimentary information to conventional histology and light microscopy without the need for preparation of stained thin sections. For the imaging conditions and spatial resolution of our study, {micro}CT may provide tissue architectural features similar to those used in Gleason grading, albeit without clear subcellular microstructure detail. At the spatial resolution of our study {micro}CT may provide novel 3D microstructure information for validation of diffusion weighted magnetic resonance imaging (MRI) methods. As an example, we demonstrate a qualitative correlation between {micro}CT-derived stromal fibre orientation and preferential water diffusion direction measured by diffusion tensor MRI microscopy of the same sample.

Spectroscopic single-molecule localization microscopy (sSMLM) enables multiplexed super-resolution imaging by simultaneously acquiring the spatial position and spectral information of individual fluorophores. Dual-wedge prism (DWP)-based implementations provide a compact, alignment-stable approach to spectral dispersion, but trade-offs between localization precision, spectral precision, and experimental complexity remain. We systematically compare five DWP-based sSMLM configurations, including two-dimensional (2D) and three-dimensional (3D) implementations using single DWP (DWP-sSMLM) and symmetrically-dispersed DWP (SDDWP-sSMLM). We evaluate lateral precision, spectral precision, and ease of use. SDDWP configurations acquire spectral images in both channels and utilize both for spatial localization, yielding the highest lateral and spectral precision. However, for applications that do not require axial information, 2D-DWP provides a simple, plug-and-play solution with robust performance. This work offers a guideline for selecting DWP configurations based on experimental needs.

Three-dimensional fluorescence microscopy often exhibits anisotropic resolution because axial information is poorly sampled and more blurred than lateral information, which complicates quantitative interpretation of fine 3D structures. Although optical remedies and computational restoration have been explored, many approaches require demanding system calibration or rely on accurate PSF models and assumptions that are difficult to satisfy across all samples and modalities. Here we present DeepIso, a self-supervised isotropy restoration framework that couples supervised pretraining with an internal-learning inference stage to estimate degradation directly from the measured volume. Without explicit PSF specification or enforced lateral-axial structural equivalence, DeepIso recovers axial frequency content and improves the continuity of elongated structures while retaining fine features, with superior performance over existing computational approaches in terms of both visual inspection and quantitative metrics. The method is validated on synthetic benchmarks and experimental datasets, demonstrating isotropy enhancement across confocal, light-sheet, and 3D structured illumination microscopy, thereby supporting downstream volumetric analysis including segmentation and tracking.